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Abstract 

y—i The causal cognitive relay channel (CRC) has two sender-receiver pairs, in which the second sender obtains 

information from the first sender causally and assists the transmission of both senders. In this paper, we study both 
the full- and half-duplex modes. In each mode, we propose two new coding schemes built successively upon one 
^ another to illustrate the impact of different coding techniques. The first scheme called partial decode-forward binning 

(PDF-biiming) combines the ideas of partial decode-forward relaying and Gelfand-Pinsker binning. The second scheme 
called Han-Kobayashi partial decode-forward binning (HK-PDF-binning) combines PDF-binning with Han-Kobayashi 
coding by further splitting rates and applying superposition coding, conditional binning and relaxed joint decoding. 
In both schemes, the second sender decodes a part of the message from the first sender, then uses Gelfand- 
r , ' Pinsker binning technique to bin against the decoded codeword, but in such a way that allows both state nullifying 

and forwarding. For the Gaussian chaimels, this PDF-binning essentializes to a correlation between the transmit 
^ signal and the binning state, which encompasses the traditional dirty-paper-coding binning as a special case when 

, this correlation factor is zero. We also provide the closed-form optimal binning parameter for each scheme. 

The 2-phase half-duplex schemes are adapted from the full-duplex ones by removing block Markov encoding, 
sending different message parts in different phases and applying joint decoding across both phases. Analysis shows 
that the HK-PDF-binning scheme in both modes encompasses the Han-Kobayashi rate region and achieves both the 
\^ partial decode-forward relaying rate for the first sender and interference-free rate for the second sender. Furthermore, 

0^ this scheme outperforms all existing schemes. 

cn 

^ I. Introduction 

^ The causal Cognitive Relay Channel (CRC) is a four-node channel with two senders and two receivers, in which 

J> the second sender obtains information from the first sender causally, then uses that to assist the transmissions of 

the first sender and its own message. Different from the assumption in the traditional cognitive channel that the 
^ secondary user knows the primary user's message non-causally, we propose several coding schemes in which the 

secondary user first decodes the primary user's message causally, then transmits the decoded message and its own 

message cognitively. 

In this paper, we study the cognitive relay channel in both full- and half-duplex modes. Analysis for the full- 
duplex mode gives us insights into the optimal coding schemes, while application to the half-duplex mode is more 
practical. In the full-duplex mode, there is no time division into sub-phases; both senders transmit all messages 
during the whole transmission. In the half-duplex mode, however, the transmission is divided into two phases with 
different message parts sent during each phase. In the first phase, the second user obtains a message from the first 
sender causally. In the second phase, these two senders transmit the messages concurrently. 
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(a) Full-duplex cognitive relay channel model. 
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(b) Half-duplex cognitive relay channel model. 
Fig. 1. The full- and half-duplex modes for the cognitive relay channel. 
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This cognitive relay channel has not been studied much in the literature. But it has tight relationships with the 
relay channel (RC), the interference channel (IC) and the cognitive interference channel (CIC). On the one hand, 
the second sender serves as a relay and helps forward the message from the first sender. On the other hand, these 
two senders interfere with each other during the transmission, and they can also cooperate cognitively. The closest 
channel to the CRC is the interference channel with source cooperation (IC with SC), in which both senders can 
exchange messages causally. 

Next, we review existing work related to the cognitive relay channel in both full- and half-duplex modes, then 
briefly summarize our main results. 

A. Related work 

1) Full-duplex case: i) Relay channel: Van der Meulen first proposes the concept of relay channel in |jT|. Cover 
and El Gamal further design several important techniques for relay channels, including decode-forward, compress- 
forward, and mixed decode-forward and compress-forward in Q. A variation of the decode-forward scheme is 
partial decode-forward, in which the relay only decodes a part of the message from the source and forwards it to 
the destination instead of decoding the whole message. Kramer, Gastpar and Gupta |[3| extend these schemes to 
the multiple-node relay networks and propose several rate regions based on decode-forward, compress-forward and 
mixed strategies. Lim, Kim, El Gamal and Chung Q propose a new scheme cafled noisy network coding (NNC) 
based on compress-forward relaying. These relay coding techniques have been widely applied in other channels. 
For example, in |5|, Liang and Kramer study the relay broadcast channel using the idea of rate splitting, block 
Markov encoding and partial decode-forward relaying. 

ii) Interference channel: Carleial first introduces the interference channel and proposes inner and outer bounds as 
well as capacity results for several special cases in |6|. Sato studies the capacity for the Gaussian interference channel 
with strong interference in ||7|. Han and Kobayashi propose the well-known Han-Kobayashi coding technique in 
|8) using rate splitting at the transmitters and joint decoding at the receivers, which to date achieves the largest 
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rate region for the interference channel. Chong, Motani, Garg and El Gamal Q propose a variant scheme based 
on superposition coding, which achieves the same rate region as the original Han-Kobayashi scheme but has fewer 
auxiliary random variables and hence reduces the encoding and decoding complexities. 

Hi) Cognitive interference channel: The cognitive interference channel is another closely related channel, which 
plays a significant role in improving spectrum efficiency. Devroye, Mitran and Tarokh first propose the concept in 
flOJ and provide an achievable rate region based on combining Gelfand-Pinsker coding pT) with Han-Kobayashi 
scheme. They study both the genie-aided (non-causal) and the non genie-aided (causal) cases. Marie, Yates and 
Kramer determine the capacity region for the channel with very strong interference in [ [T2| . Wu, Vishwanath and 
Arapostathis determine the capacity region for the weak interference case in p3) . Other coding schemes for the 
cognitive interference channel can be seen in 1 14|-p6). Jovicic and Viswanath p7) analyze the Gaussian cognitive 
channel and give the largest rate for the cognitive user under the constraint that the primary user experiences no 
rate degradation and uses single-user decoder Rini, Tuninetti and Devroye [18J further propose several new inner, 
outer bounds and capacity results based on rate spitting, superposition coding, a broadcast channel-like binning 
scheme and Gelfand-Pinsker coding. 

An important technique used in all cognitive coding is the binning technique proposed by Gelfand and Pinsker in 
| [TT| . In Gelfand-Pinsker binning, the state of the channel is known at the input, but unknown at the output. Marton 
pg) proposes the double binning scheme and applies it to the broadcast channel. Kim, Sutivong and Cover |20| 
further analyze Gelfand-Pinsker binning to allow the decoding of a part of state information at the destination at 
a reduced information rate. Costa fT\\ applies Gelfand-Pinsker binning to the Gaussian channel and proposes the 
well-known dirty paper coding (DPC) scheme, which achieves the same rate as if the channel is interference free. 
A surprising feature of DPC binning is that the transmit signal is independent of the state. 



iv) Interference channel with source cooperation: Host-Madsen |22| studies outer and inner bounds for the 
interference channel with either destination or source cooperation. The achievable rate for source cooperation is 
based on block Markov encoding and dirty paper coding, which includes the rate for decode-forward relaying but 
not the Han-Kobayashi region. Prabhakaran and Viswanath | |23] investigate the Gaussian interference channel with 
source cooperation and propose an achievable rate region built on block Markov encoding, superposition coding 
and Han-Kobayashi scheme, but without binning, as well as several upper bounds on the sum rate. Wang and 
Tse p4| study the Gaussian interference channel with conferencing transmitters and propose an achievable rate 
region within 6.5 bits/s/Hz of the capacity for all channel parameters. The channel is based on conferencing model, 
in which the common message parts are known though noiseless conference links between the two transmitters 
before each block transmission begins, hence there is no need for block Markovity. The scheme utilizes Marton's 
double binning for the cooperative private messages and superposition coding but not dirty paper coding for the 
non-cooperative private message parts. Cao and Chen ||25) propose an achievable rate region for the interference 
channel with transmitter cooperation using block Markov encoding, rate splitting and superposition coding, dirty 
paper coding and random binning. This scheme includes the Han-Kobayashi region but not the decode-forward 
relaying rate. Yang and Tuninetti p6) study the interference channel with generalized feedback (also known as 
source cooperation) and propose two schemes. The first scheme uses rate splitting and block Markov superposition 
coding only, in which the two users send common messages cooperatively. The second scheme extends the first 
one by using both block Markov superposition coding and binning, in which parts of both common and private 
messages are sent cooperatively. This scheme also achieves the Han-Kobayashi region but not the decode-forward 
relaying rate. We will discuss the schemes in p5) , p6| in more details in Section [III-C| Tandon and Ulukus | |27| 
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Study an outer bound for the MAC with generahzed feedback based on dependence balance 1 28 1 and extend this 



idea to the interference channel with user cooperation. We will apply this outer bound in Section IV-F 



2) Half-duplex case: For half-duplex communications, results also exist for the above channels, albeit fewer than 
in the full-duplex case. 

Host-Madsen and Zhang study capacity bounds for the half-duplex relay channel based on time-division in p9) , 
pOJ and give achievable rates for the Gaussian relay channel using partial decode-forward and compress-forward. 



Zhang, Jiang, Goldsmith and Cui 1 3 1 1 study the half-duplex Gaussian relay channel with arbitrary correlated noises 
at the relay and destination. They also evaluate the achievable rates using decode-forward, compress-forward and 
amplify-forward, showing none of these schemes strictly outperforms the others. 

Peng and Raj an p2) study the half-duplex Gaussian interference channel and compute several inner and outer 
bounds for transmitter or receiver cooperation. Transmitter cooperation uses decode-forward and divides the trans- 
mission into 3 phases: 2 broadcast phases and 1 MIMO cooperative phase. Wu, Prabhakaran and Viswanath | |33| 
further study source cooperation for the half-duplex interference channel in the symmetric linear deterministic case 
and compute its sum rate. 

For the half-duplex cognitive interference channel, Devroye, Mitran and Tarokh fTO) propose four protocols in 
which the secondary user obtains the message from the primary user causally. Time-sharing these 4 protocols can 



achieve the Han-Kobayashi rate region but not the decode-forward relaying rate. Chatterjee, Tong and Oyman |34| 
further propose a new achievable rate region by a 2-phase scheme based on rate spUtting, block Markov encoding, 
Gelfand-Pinsker binning and backward decoding. This scheme can only achieve the rate of decode-forward relaying, 
which is less than the partial decode-forward rate in the half-duplex mode. We will discuss these two schemes in 
more details in Section IVI-CI 



B. Summary of Main Results 

In this paper, we fully define the cognitive relay channel in both the full- and half-duplex modes and propose 
several coding schemes based on partial decode-forward relaying, Gelfand-Pinsker binning and Han-Kobayashi 
coding. 

1) Full-duplex case: The full-duplex cognitive relay channel is a four-node channel with two sender-receiver 
pairs 5*1 -Ti and S2-T2, as in Figure [TJa). Si and S2 want to transmit messages to Ti and T2, respectively. 5*2 also 
serves as a relay by forwarding S'l's message to Ti while transmitting its own message to T2. Since S2 can both 
relay and apply cognitive coding at the same time, this gives rise to the name Cognitive Relay Channel (CRC). 

We propose two new coding schemes, in which the second scheme is built successively on top of the first one 
to illustrate the effect of each technique used. 

• The first scheme is called partial decode-forward binning (PDF-binning), which utilizes rate splitting, block 
Markov encoding, partial decode-forward relaying, Gelfand-Pinsker binning and forward joint decoding across 
two blocks. Si divides its message into two parts: one as a private message sent to Ti directly, the other as a 
forwarding message, which is sent to Ti with the help of 5*2. 5*2 first causally decodes the forwarding message 
part from 5*1, then uses the decoded codeword as the binning state. In this case, however, the binning also 
allows ^2 to forward a part of the state to Ti, who then uses joint decoding across two blocks to decode its 
messages from both 5*1 and ^2. Different from state amplification in pO) , here we want to decode the state 
at a different receiver (Ti) from decoding the message (22). This scheme achieves the partial decode-forward 
relaying rate for user 1 and Gelfand-Pinsker rate for user 2. 
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• The second scheme is called Han-Kobayashi PDF -binning (HK-PDF-binning), which combines PDF-binning 
with Han-Kobayashi coding by having both users further split their messages. 5*1 divides its message into three 
parts: one as the Han-Kobayashi (HK) private message decoded only at Ti, another as the HK public message 
decoded at both Ti and T2, and the final part as the forwarding message. ^2 divides its message into two 
parts: one as the HK private message and the other as the HK public message. There are three ideas additional 
to PDF-binning. First, in performing partial decode-forward, S2 uses conditional binning instead of traditional 
binning to bin only its private message part. Second, although Ti uses joint decoding in both schemes, the 
decoding rule here is relaxed as Ti also decodes the public message from 5*2 without requiring it to be correct. 
Third, instead of simple Gelfand-Pinsker decoding, T2 uses joint decoding of the binning auxiliary random 
variable and the HK public messages from the two senders which are encoded independently of the state. 
HK-PDF-binning achieves both the Han-Kobayashi and the PDF-binning rate regions. 

2) Half-duplex case: For the half-duplex CRC, the transmission is divided into two phases as in Figure [T](b). In 
the first phase. Si transmits to S2, Ti and T2. In the second phase, the two senders transmit messages simultaneously, 
during which ^2 can both relay and apply cognitive encoding. 

We adapt the above two coding schemes to the half-duplex case. The main challenges in adapting full-duplex 
schemes to the half-duplex mode include deciding which message parts should be sent in which phase and changing 
the destination decoding rule to joint decoding across both phases. 

Specifically, we propose two half-duplex (HD) schemes: HD-PDF-binning and HD-HK-PDF-binning. At the end 
of the first phase in both schemes, S2 decodes a message part from Si then applies PDF-binning, but neither Ti 
nor T2 decode here. Both Ti and T2 only decode at the end of the second phase. There are several differences 
from full-duplex coding. First, not all message parts are sent in each phase. Second, there is no need for block 
Markovity, instead, we superposition codewords in the two phases of the same block. Third, we use joint decoding 
at the destinations over two phases of the same block instead of over two consecutive blocks. 

3) Applications to Gaussian channels: When applied to the Gaussian channel, a major difference between PDF- 



binrring and the traditional binning in dirty paper coding (DPC) |21| is that we introduce a correlation between 
the transmit signal and the state. This correlation allows both binning and forwarding at the same time, thus helps 
improve the transmission rate for the first user and still allows the second user to achieve the interference-free 
rate. We derive the closed-form optimal binning parameter for each coding scheme. This PDF-binning parameter 
contains the DPC-binning parameter as a special case. 

Results show that the HK-PDF-binning scheme outperforms all existing schemes in both the full- and half-duplex 
modes for the cognitive relay channel. Our analysis also shows clearly the impact on rate region of each of the 
techniques used. Furthermore, the maximum rate for the primary sender is the rate of partial decode-forward relaying 
and the maximum rate for the secondary sender is the interference-free rate as in dirty paper coding. 



II. CRC Channel Models 

A. Full-duplex DM-CRC model 

The full-duplex cognitive relay channel consists of two input alphabet Xi,X2, and three output alphabets 
3^1,3^2,3^- The channel is characterized by a channel transition probability p{y i, 1/2, y\xi,X2), where xi and X2 
are the transmit signals of Si and 5*2, yi, y2 and y are the received signals of Ti, T2 and S'2. Figure [TJ a) illustrates 
the channel model, where Wi and W2 are the messages of Si and S'2. For notation, we use upper case letters to 
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indicates random variables and lower case letters to indicate their realizations. We use x" and xj! to represent the 
vectors (a;i, . . . , a;„) and (xk, ■ ■ ■ , Xn) respectively. 

The cognitive relay channel has tight relationships with the interference and the relay channels. For example, 
this channel model can be converted to the interference channel ||6| if 5*2 does not forward any information to Ti. 
Similarly, this channel reduces to the relay channel |l], ||2j if 5*2 does not have any message for T2. 

A (2"^i, 2"^^, n) code, or a communication strategy for n channel uses with rate pair (Ri, R2), consists of the 
following: 

• Two message sets Wi x 1^2 — [1,2"^^] x [1,2"^^] and independent messages Wi,W2 uniformly distributed 
over Wi and 1^2, respectively. 

• Two encoders: one maps message wi into codeword x'^{wi) S A'", and one maps W2 and each received 
sequence y''^^ into a symbol X2k{'W2,y'^^^) G X2. 

• Two decoders: one maps y" into t&i e Wi; one maps into W2 G VV2- 

The probability of error when the message pair (Wi,W2) is sent is defined as Pe{Wi,W2) = P{{Wi,W2) ^ 
(Wi, ^2)}- A rate pair (i?i, R2) is said to be achievable if, for any e > 0, there exists a code such that the average 
error probability Pg < e as n ^ 00. The capacity region is the convex closure of the set of all achievable rate pairs. 

B. Half-duplex DM-CRC model 

The half-duplex cognitive relay channel also consists of four nodes: two senders Si, S2 and two receivers Ti, 
T2. 5i wants to send a message to Ti. S2 serves as a causal relay node and helps forward messages from to Ti, 
while also sending its own message to T2. The transmission in the half-duplex mode is divided into two phases. 
In the first phase, 5*1 transmits its message and 5*2, Ti and T2 listen. In the second phase, both 5*1 and 5*2 transmit 
and Ti and T2 listen. This 2-phase transmission allows, for example, S2 to decode a part of the message from Si 
in the first phase and then forwards this part with its own message in the second phase. 

Formally, the half-duplex cognitive relay channel consists of three input alphabet Xn, X12, X22, and five output 
alphabets J^n, 3^21, y, 3^i2, 3^22- The channel is characterized by a channel transition probability 
Pc(2/ii, 2/21, 2/, 2/12, 2/22, |a;ii, a;i2, a;22) defined as 

{p(2/ii,2/2i,2/Nii) if < i < T, 

(1) 
P(2/12, 2/22 1 2^12, 2:22) ifT<t<l, 

where t is the normalized transmission time within 1 block, xn and X21 refer to the transmit signals of Si in the 
first and second phases, respectively; 2:22 refers to the transmit signal of ^2 in the second phase {S2 does not send 
any signal in the first phase); j/n and j/12 are the received signals of Ti in the first and second phases; 2/21 and 1/22 
are the received signals of T2 in the two phases; and y is the received signal of S2 in the first phase. We assume the 
channel is memoryless. Figure [TJb) illustrates the channel model, where Wi and W2 are the messages of 5*1 and 
S'2. We use the notation x"^" ~ {xi, X2, ■ ■ ■ , Xm) and x"^" — {xm+i, ■ ■ ■ , Xn), which correspond to the codewords 
sent during the first and second phases. 

A (2"^\ 2"^2^ code, or a communication strategy for n channel uses with rate pair R2), consists of the 
following: 

• Two message sets Wi x W2 — [1,2"^'^] x [1,2"^^] and independent messages Wi,W2 that are uniformly 
distributed over Wi and 1^2- 
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Fig. 2. Coding structure for tlie full-duplex PDF-binning scheme at block i. (SP stands for superposition) 



• Three encoders: two that map message wi into codewords S and x"2(wi) G ^'"2, and one that 
maps W2 and y™ into a codeword X22{w2,y'^") G A'22- 

• Two decoders: One maps into wi S Wi; and one maps j/j into W2 G yV2- 

The probabiHty of error, achievable rate and capacity region are defined in a similar way to the full-duplex case. 

III. Full-duplex partial decode-forward binning schemes 
A. PDF-binning scheme 

The first scheme uses block Markov superposition encoding at 5*1 and partial decode-forward relaying and 
Gelfand-Pinsker binning at S'2. Ti uses joint decoding across two blocks while T2 uses normal Gelfand-Pinsker 
decoding. The first sender 5*1 splits its message wi into two parts {wio,wii), which correspond to the common 
(forwarding) and private parts. We use block Markov encoding at 5*1, such that the current-block common message 
wio is superimposed on the previous-block common message w[q. Then, message wu is superimposed on both 
w'lQ and Wif). The second sender ^2 decodes the previous common message w[q from the first sender 5*1 then uses 
binning to bin against the codeword for this message part. Depending on the joint distribution between the binning 
auxiliary random variable and the state that S'2 can also forward a part of the state (i.e. message w'iq) to Ti. The 
encoding and decoding structure can be seen in Figure |2] in which w'iq corresponds to Wio[i-i]- 

Theorem 1. The convex hull of the following rate region is achievable for the full-duplex cognitive relay channel 
using PDF-binning: 

f Ri <IiUio;Y\Tio)+IiXi;Yi\Uio,Tw) 
U] ^1 </(Tio,f/io,^i;yi) (2) 

where 

Pi = p(iio)p(wio |iio)p(a;i 1^10, wio)p(u2|iio)p(a;2 1^10, "2)^(2/1, 2/2, y|a;i,a;2). 

Remark 1. The maximum rate for each user. 

• The first user Si achieves the maximum rate of partial decode-forward relaying if we set U2 = 0, X2 = Tiq. 

max min{/(C/io;r|X2)+/(Xi;ri|C/io,X2),/(Xi,X2;ri)} (3) 

p{uio,X2)p(xi\uio,X2) 

In this case, there is no binning but only forwarding at S'2. 
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• The second user ^2 achieves the maximum rate of Gelfand-Pinsker's binning if we set Tio — Uiq — Xi. 

i?r"= , max {/(C/2;r2)-/(C/2;Xi)} (4) 

p{xi,U2)p(X2\xi,U2) 

In this case, there is no forwarding of the state at 82- 

Proof: The transmission is done in B blocks, each consists of n channel uses. 5*1 splits each message wi 
into two independent parts (wio,wii). During the first B — 1 blocks. Si encodes and sends a message tuple 
(^(7lo[,_l],Wlo^,u;ll,) G [1,2''^"'] x [l,2"-«i°] x [l,2"-«ii]; S2 encodes and sends message (wio[,_i] , u'2«) e 
[1, 2"-'^"'] X [1, 2"^2], where i — 1,2, .... B — 1 denotes the block index. When i? — > 00, the average rate triple 
{Rw^,Rii^,R2^) approaches to (Rw, Rn, R2). 
We use random codes and fix a joint probability distribution 

p{tlQ)piuiQ\tio)p{xi\tio,UiQ)p{u2\tio)p{x2\tlo,U2). 

1) Codebook generation: For each block i (We can also just generate two independent codebooks for the odd 
and even blocks to make the error events of two consecutive blocks independent |5|.): 

• Independently generate 2"^" sequences t^Q ~ 11^=1 ^(^lofc)- Index these codewords as ^^^{w'iq), w'^q E 
[l,2"-«i°]. 

• For each iio(if'io)' independently generate 2"-^'^° sequences m"q ^ rife=i P(^iofcl^iofc)- Index these codewords 
as u"q(wio|u'']^o)' ""^10 £ [l; 2"^!"]. wiq contains the common message of the current block, while w[q contains 
the common message of the previous block. 

• For each ^10(^^0) and u^q{wio\w[q), independendy generate 2"^" sequences ^ Yrk=iPi^ik\tiok,'Uiok)- 
Index these codewords as a;"(wii, wiolw'io). wu e [1,2"^"], wio e [1,2^^"']. 

• Independently generate 2"(^2+fl:2) sequences U2 ^ 111'=! -P('"2fe)- Index these codewords as 112(^2, ^^2)^ W2 £ 
[l,2"-«2] and V2 G [1,2"^^'^]. 

. For each <io(wio) and 1*2(^2, ^2), generate one X2 ^ Y\k=iPix2k\tiak,U2k)- Denote X2 by ^2 (wio, ^2, W2)- 

2) Encoding: At the beginning of block i, let (wioi, wm, W2i) be the new messages to be sent in block i, and 
(wioii^i], Wiii^i^i], W2ii-i]) be the messages sent in block i — 1. 

• 5*1 knows w;io[j-i], in order to send (wioi, wni). Si transmits a;" (wni, wioi|wio[i-i]). 

• 5*2 searches for a V2i such that 

itwi^lQ[^-l]),u'^iw2^,V2^)) € A^"' (PtioC/2 ) ■ 

Such a V2i exists with high probability if 

R2>IiU2;T,o). (5) 

5*2 then transmits (i«io[i-i] , ^217 ^^21) • 

3) Decoding: At the end of block i: 

• 5*2 knows Wio[i_i] and declares message wioi was sent if it is the unique message such that 

(^^o(«^10[.-l])'<o(^"l0^hlO[^-l]),y"(^)) e A'■;'\PT,„U^oY), 

where y"{i) indicates the received signal at 5*2 in block i. We can show that the decoding error probability 
goes to as n —T' 00 if 

-Rio </(C/io;i"|Tio). (6) 
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Fig. 3. Coding stracture for the full-duplex Han-Kobayashi PDF-binning scheme at block i. 



• Ti knows Wio[,;-2] and decodes (wiofi-i], based on the signals received at block i — 1 and block i. 
It declares that message pair (t&io[i-i] j was sent if it is the unique pair such that 

{tloi'^W[t-2]),u'lo{wio[i-l]\wio[,_2]),x'^{wi^^^ - 1)) G ^^"^^VioC/ioXi Yi ) 

and itu^m^-i]),yi{^)) e A^r\PT,on)- 

The decoding error probability goes to as 71 — > oo if 

Rii<I{Xi;Yi\Uio,Tio) 
Rio + Rii<HTio,Uio,Xi;Yi). (7) 

• T2 treats Tig, a part of the signal from 5*1, as the state and decodes W2i based on the signal received at block 
i. Specifically, T2 decodes W2i directly using joint typicality between U2 and 2/2- It declares that message W2i 
was sent if it is unique such that 

{u^iw2,,V2^),y^i^)) € Ai^HPu.Y,) 

for some V2i- The decoding error probability goes to as n —> 00 if 

R2+R'2<IiU2;Y2). (8) 

Let i?i ~ Rio + Rii, apply Fourier-Motzkin Elimination |35| on constraints (|5]l-([8]), we get the rate region in (|2|. 

■ 

Remark 2. While the idea of the basic PDF-binning scheme is straightforward, this scheme allows the understanding 
of binning to achieve the maximum rates of partial decode-forward relaying at user 1 as in (|3]l and Gelfand-Pinsker 
coding at user 2 as in (|4]). The importance magnifies in the Gaussian application in Section |IV] This scheme helps 
build the base for more complicated schemes later. 

B. Han-Kobayashi PDF-binning scheme 

Figure [3] illustrates the idea of the full-duplex Han-Kobayashi PDF-binning scheme. Built upon PDF-binning, 
each user further splits its message to incorporate Han-Kobayashi coding. Message wi is split into three parts: 
wiQ,wii,wi2, corresponding to the common (forwarding), public and private parts, and message W2 is split into 
two parts: ^21,^22, corresponding to the public and private parts. Take the transmission in block i as an example. 
At 5*1, the current common message wiQi is superimposed on the previous commons message wiofi-i]; message 
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Win is encoded independently of both Wio[i-i] and Wiof, message Wi2i is then superimposed on all three messages 
^io[i-i]' ■"'lOi and wioi. S2 decodes ?Z'io[j-i] of the previous block and uses conditional binning to bin its private 
part W22[i] against Wio[i-i], conditionally on knowing the public part W2i[i]- At the end of block i, Ti uses joint 
decoding over two blocks to decode a unique tuple (u'io[i-i], 'ii'iiii-i] , i&i2[i-i]) for some u)2i[i-i] without requiring 
this message part to be correct. T2 treats the codeword for Wio[i-i] as the state and searches for a unique pair 
{w2ii,W22i) for some wm. The detailed coding and decoding procedures are shown in the proof of Theorem |2] 
below. 



Theorem 2. The convex hull of the following rate region is achievable for the cognitive relay channel using 
HK-PDF -binning: 

Ri < min{/2 + /5,/6} 

R2 < I12 — Ii 

R1+R2 < min{/2 + h, h} + Ii3 - h 

R1+R2 < min{/2 + /3, h} + hi - h (9) 
R1+R2 < min{/2 + /g, Iio} + 111 - h 
2Ri +R2 < min{/2 + h, h} + min{/2 + /g, ho} + hs - h 
Ri + 2i?2 < min{/2 + h, h} + hi - h+ In - h 
where 

P2 =p{tin)p{uin\ho)p{uii)p{xi |iio, wio, uii)p{u2i)p{u22\u2i,tio)p{x2\tw, U21, '"22)?'(yi, 2/2, 2/|a;i, 2:2), (10) 
and Ii — /i4 are defined as 



u 

P2 



h 


^ I{U22;Tio\U2l) 




h 


^ I{Uio;Y\Tio) 




h 


= /(Xi;ri|rio,C/io,C/ii,C/2i) 




h 


= /(C/io,Xi;Yi|rio,i7ii,C/2i)H 


-I{Tio;Yi) 


h 


^ IiUii,Xi;Yi\Tio,Uio,U2i) 




h 


= IiUio,Uii,Xi;Yi\Tio,U2i)^ 


'I{Tio\Yi) 


h 


= I{Xi,U2i;Yi\Tio,Uio,Uii) 




h 


= I{Uio,Xi,U2i;Yi\Tio,Uii)^ 


-I{Tio;Yi) 


h 


^ IiUii,Xi,U2i;Yi\Tio,Uio) 




ho 


= I{Tio, Uio, Uii,Xi, U2i;Yi) 




hi 


= I{U22;Y2\U21,Uii) 




I12 


= I{U21,U22;Y2\Uii) 






^ I{Ull,U22;Y2\U2l) 




hi 


^ I{Uii,U21,U22;Y2). 





(11) 



Remark 3. Inclusion of PDF-binning and Han-Kobayashi schemes. 

• The HK- PDF-binning scheme becomes PDF-binning if Uu = U21 = ' 
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• The HK- PDF-binning scheme becomes the Han-Kobayashi scheme if Tip = Uiq = and X2 = U22- 

• The maximum rates for Si and 5*2 are the same as in the PDF-binning scheme in ([3]) and Q. 

Proof: We use random codes and fix a joint probabiHty distribution 

P{tlo)p{uio\tlo)p{uil)p{xi\tio, Wio, Uii)p{u2i)p{u22\u21,tio)p{x2\tio, M2I, W22)- 

1) Codebook generation: For each block i (or for odd and even blocks): 

• Independently generate 2"^"' sequences t^Q ^ IlI—i P(^iofc)- Index these codewords as iio(w'io), w'^q G 
[l,2"-«i°]. 

• For each ^10(^^0), independently generate 2"^i" sequences u"q ^ IlI—i P('"iofc|^iofc)- Index these codewords 
as u"q(wio|u'']^q), Wio G [1, 2"'''i'']^ y;^^^ jg tjjg common message of the current block, while w'^q is the common 
message of the previous block. 

• Independently generate 2"-'^" sequences u"]^ ^ YYk=iP{'^iik)- Index these codewords as w"]^(u'ii), wn € 
[1,2"'""]. 

• For each iio(w']^g), ^"0(10101^5^0) ^'^'^ Uii(wii), independently generate 2"^!^ sequences 

2^1 ^ Y[l=iP{xik\twk,uiQk,uiik). Index these codewords as x'1{wi2\wii,ww,w[q), W12 G [l,2"-^i2]^ 

• Independently generate 2"^^^ sequences ~ Ilfc^i P('^2ife)- Index these codewords as '«2i('"^2i), W21 G 
[l,2"-«2i]. 

• For each U2i('^2i)^ independently generate 2"'^-^-^^'^-^^^^ sequences U22 ^ 11^=1 ^(^^22/0 1^21*;) • Index these 
codewords as u52(^«22, W22IW21), W22 € [1,2"^22] and V22 G [1,2"^22]. 

. For each iio(wio)' ^*2i(w2i) and W22(w^22, W22IM21), generate one x^' Y[k=iPi^2k\tiok,U2ii,U22i). Denote 

2^2 by 2:2 (w'lO' "^21,^22, 'y22)- 

2) Encoding: At the beginning of block i, let (luioi, wni, i(Ji2i, W2ii, '!i'22j) be the new messages to be sent in 
block i, and (wio[i-i] , Wi2[j-i], if2i[i-i] , W22[i-i]) be the messages sent in block i - 1. 

. 5*1 knows Wio[j_i], in order to send (wioi,wiu,wi2i), it transmits x5'(ti;i2|u;iii, wioi, Wio[i-i])- 

• 5*2 searches for a f 221 such that 

itloiWlO[^-l]),u'^l{w21^),U^2{w22^,V22^\w21^)) € A'-/'\Pt,„U22\U2i) ■ (12) 

Such a W22i exists with high probability if 

R'22>HU22;Tio\U2l). (13) 

5*2 then transmits (wio^-i] ; 'f^2ii, ^22,, W22j)- 

3) Decoding: At the end of block i: 

• 5*2 knows Wio[i_i] and declares message wioi was sent if it is the unique message such that 

where indicates the received signal at 52 in block i. We can show that the decoding error probability 

goes to when n — >^ cxd if 

i?io </(C/io;i"|Tio)- (14) 
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• Ti knows Wio[i-2] ™d searches for a unique tuple (twiofi-i] i u^njj^i], Wi2[i_i]) for some W2i[i-i] such that 

{tloi'>^W[i-2]),Uio{wio[i-i]\wio[i-2]),Uii{wii[i_i^^ 

"2l(*21[*~l]),yr(j - 1)) e ^^"^(^VioC/ioC/iiXiC/siri) 

and (i?oKo[^-i]),2/i«)e^("n^T,oFj- (15) 
The decoding error probabiUty goes to as n cx) if 

Ri2 < HXi;Yi\Tw,Uw,Uii,U2i) 
Rw + Ri2 < I{UiQ,Xi;Yi\Tio, Uii, U21) + /(Tio;^) 
Rii + R12 < I{Uii,Xi;Yi\Tio, C/10, U21) 
Rio + Rn + Ri2 < I{Uw, C/11, Xi; FilTio, U21) + /(Tio; Fi) 

R12 + R21 < HXi, C/21; FilTio, C/10, C/11) 
i?io + i?i2 + i?2i < /(C/10, ^1, C/21; FilTio, C/11) + /(Tio; Fi) 
i?ii + i?i2 + R21 < /(C/n, ^1, C/21; FilTio, C/10) 
i?io + i?ii + i?i2 + i?2i < /(Tio, C/10, C/ii,Xi,C/2i;Fi). (16) 

• T2 treats T]}j{w[f^^-_^) as the state and decodes {w2ii,W22i,V22i) based on the signal received in block i. 
Specifically, T2 searches for a unique (w2ii,'W22i) for some (wiii,C'22i) such that 

Kl(wilO,W2i(w2H),W22(w22«,W22i|w2H),y2(*)) G ^^^-PUii (721 C/22 Y2 ) ■ (17) 

The decoding error probability goes to as n oo if 

i?22+i?22 </(f^22;F2|C/21,C/ii) 

i?21 + i?22 + i?22 < /(C^21, C/22; r2|C/ii) 

i?ll + i?22 + i?22 < /(C^ll, C^22; i^2|C/2l) 

i?ll+i?21+i?22+i?22 </(C^ll,C^21,C/22;i^2). (18) 

Applying Fourier-Motzkin Elimination to ([T3]l-([T8]l, we get rate region (|9]). ■ 

Remark 4. Several features of the HK-PDF-binning scheme are worth noting: 

• In encoding, wiq and wn are encoded independently, then wi2 is superpositioned on both. This independent 
coding between the forwarding part (i«io) and Han-Kobayashi public part (wu), rather than superposition, is 
important to ensure the rate region includes both PDF-binning and Han-Kobayashi regions. 

• In the binning step ( [T2] i at 5*2, we use conditional binning instead of the usual (unconditional) binning. The 
binning is only between the Han-Kobayashi private message part (u>22) and the state {w[q), conditionally 
on knowing the Han-Kobayashi public messsage part u'21. This conditional binning is possible since ti;2i is 
decoded at both destinations. 

• In the decoding step ( [T7] i at T2, we use joint decoding of both the Gelfand-Pinsker auxiliary random variable 
(U22) and the Han-Kobayashi public message parts (wu and W21), instead of decoding Gelfand-Pinsker and 
Han-Kobayashi codewords separately. This joint decoding is possible since the codewords for wu and W21 
(i.e. Uii and M21) are independent of the state in Gelfand-Pinsker coding (i.e. tio). Joint decoding at both Ti 
( fTsj l and T2 ( [T7| i help achieve the largest rate region for this coding structure. 
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C. Comparison with existing schemes for the interference channel with source cooperation 



In this section, we analyze in detail two existing schemes p5| , |26| for the interference channel with source 
cooperation, which are most closely related to the proposed schemes. The interference channel with source coop- 
eration is a 4-node channel in which both Si and S2 can receive signal from each other and use that cooperatively 
in sending messages to Ti and This channel therefore includes the CRC as a special case (when 6*2 sends no 
information to Si). 

1) IC with conferencing: Cao and Chen 125) propose an achievable rate region for the interference channel 
with source cooperation based on rate splitting, block Markov encoding, superposition encoding, dirty paper coding 
and random binning. Each user splits its message into three parts: common, private and cooperative messages 
and divides the cooperative message into cells. The second user generates independent codewords for the current 
common message {U2), previous cooperative cell index (s^) and current cooperative message (102 )■ The codewords 
for the current private message are then superimposed on the current common message and previous cooperative 
cell index 1^2 1 s^)- Then, the first user treats the previous cooperative-cell-index codeword {s^) as the state and 
jointly bins its codewords for the current common message (n"), previous cooperative cell index (/i") and current 
cooperative message (5"). Finally, the codewords for the first user's private message (m") is conditionally binned 
with .S2 given n" and /i". A two-step decoding with list decoding is then used at each destination. 

The common, private and cooperative message parts in p5) correspond roughly to our HK public, HK private 
and forwarding (common) part, respectively. As such, when applied to the CRC, their scheme differs from the 
proposed HK- PDF-binning scheme in the following aspects: 

• Block Markovity is applied only on the HK private part, whereas in our scheme, block Markovity is applied 
on all message parts. 

• Block Markovity is based on cell division of the previous cooperative message, while in our scheme, block 
Markovity is on the whole previous common message. This, however, is a minor difference since if each cell 
contains only one message, then cell index reduces to message index. 

• The first user bins both its HK public and private parts (the user labels are switched in [25]), whereas we only 
bin the HK private part (see Remark |4|. 

• The scheme in 1251 cannot achieve the decode-forward relaying rate because of no block Markovity between 
the current cooperative-message codeword (^2) ^nd the previous cooperative -cell codeword (sj)- In other 
words, there is no coherent transmission between the source and relay, which can be readily verified from 
the code distribution. Consider setting Vi ^ V2 ^ Ui ^ U2 ^ 0, Mi = M2 = Ni = N2 = and 
W2 — S2 — G2 = H2 = in equation (8) of p5| , then the code distribution reduces to 

P{q)p{9i\(l)p{hi\q)p{xi\gi,q)p{x2\hi,q) ^ p{q, gi, xi)p{q, hi, X2) 7^ _p(g, Xi, X2), 

where q is the time sharing variable. This distribution implies that the first user splits its message into two 
parts and independently encodes each of them (by gi and hi). The second user then decodes one part in gi 
and forwards this part to the destination. But because of the independence between gi and hi, the achievable 
rate is less than in coherent decode-forward relaying. 

Thus, the claim in Remark 2 of p5) that this scheme achieves the capacity region of the degraded relay channel 
is in fact unfounded. 

2) IC with generalized feedback: Yang and Tuninetti p6) propose two schemes for the interference channel 
with generalized feedback based on block Markov superposition coding, binning and backward decoding. Since the 
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first scheme is a special case of the second, we only analyze their second scheme. Each user splits its message 
into four parts: cooperative common (wiqc), cooperative private (wiic), non-cooperative common (wion) and non- 
cooperative private (wun)- Consider the transmission in block b. First, generate independent codewords for the 
previous cooperative-common messages of both users ((3"(u'ioc,h-i, 'iA'20c,h-i))- Then the cooperative-common 
(wiocb), non-cooperative common (u)io„.f,) and non-cooperative private (wnn.b) messages are superimposed on 
each other successively as Vi, Ti, Ui, respectively (according to p{vi,ti,ui\q)). There are three binning steps after 
the above codebook generation. First, the codewords 5*1, 5*2 for the previous cooperative-private messages of both 
users are binned with each other given Q. Second, Vi, Ui and Ti are binned with 5*1 and ^2 given Q. Third, the 
codeword Zi for the cooperative-private message (wuc^b) is conditionally binned with 52, Ui and Ti given Vi, 
Si and Q. Backward decoding is used, in which each destination applies relaxed joint decoding of all interested 
messages. 

The non-cooperative messages in f2E\ correspond to our HK public and private parts. Their scheme has two 
cooperative message parts (the common is decoded at both destinations while the private is not), whereas the 
proposed HK-PDF-binning has only one common part. To compare these two schemes, we consider the following 
two special settings to make the message parts equivalent: 

i) Set the cooperative-common message (wioc) to 0: Their cooperative private message then corresponds to our 
forwarding (common) message. Their scheme differs markedly from HK-PDF-binning as follows. 

• User 1 uses binning among the three message parts instead of superposition coding as in HK-PDF-binning. 
Block Markov superposition is also replaced by binning with the codeword for the previous cooperative 
message. 

• User 2 applies joint binning of both the non-cooperative common and private parts instead of conditional 
binning of only the non-cooperative private part, given the non-cooperative common part (see Remark]?]). 

ii) Set the cooperative-private message (wuc) to 0: Their cooperative common message then corresponds to our 
forwarding (common) message. Their scheme is more similar to HK-PDF-binning, but there are several important 
differences as follows. 

• User 1 now uses superposition coding, but superimposes all three message parts successively, whereas we 
generate codewords for the forwarding part and the HK public part independently (see Remark ]4]i. 

• User 2 also applies joint binning of both non-cooperative message parts instead of conditional binning, similar 
to case i). 

• Destination 2 decodes the cooperative-common part of user 1, thus limits the rate of user 1 to below the 
decode-forward relaying rate because of the extra rate constraint at destination 2 (this applies even with 
relaxed decoding). In our proposed scheme, the forwarding part of user 1 is not decoded at destination 2. 

As a result, both schemes in I^Fl and |'26'|, when applied to the CRC, achieve the Han-Kobayashi region but not 
the decode-forward relaying rate for the first user Thus, the maximum rates for user 1 in both schemes are smaller 
than in (|3]l. 

Another point is that, in both | ]25| and p6) , joint decoding of both the state and the binning auxiliary random 
variables is used at the destinations, but this joint decoding is invalid and results in a rate region larger than is 
possible. In our proposed scheme, all message parts that are jointly decoded with the binning auxiliary variable at 
the second destination are encoded independently of the state. 

Remark 5. Based on our analysis, we conjecture that splitting the common (forwarding) message further into two 



parts is not necessary for the CRC. In |24|, p6), the common message is split into two parts: one for decoding at 
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Fig. 4. The standard full-duplex Gaussian cognitive relay channel. 



the other destination and the other for binning. Our analysis shows that both these operations can be included in 
one-step binning by varying the joint distribution between the state and the auxiliary random variable. This joint 
distribution becomes apparent when applying to the Gaussian channel as in Section IV next. 



IV. Full-duplex Gaussian CRC rate regions 

A. Full-duplex Gaussian CRC model 

In this section, we analyze the standard full-duplex Gaussian cognitive relay channel model as follows. 

Yi^Xi+ bX2 + Zi 
Y2 - aXi +X2 + Z2 

Y = cXi + Z, (19) 

where Zi, Z2, Z ~ A^(0, 1) are independent Gaussian noises. Assume that the transmit signals Xi and X2 are 
subject to power constraints Pi and P2, respectively. 

The standard Gaussian CRC is shown in Figure [4] If the original channel is not in this standard form, we can 
always transform it into the standard form using a procedure similar to the interference channel ||6|. 

B. Signaling and rates for full-duplex PDF-binning 



In the Gaussian channel, the signals Tio, Uw, U2, Xi and X2 of the PDF-binning scheme in Section III-A can 
be represented as follows. 

Tio = aS'io(wio)' 

Uio = a5'io(wio) + PSio{wia), 

Xi ^ aS[Q{w[„) + I3Siq{wiq) + jSii{wii), 

X2^li [pS'M,) + Vi - 9^822) , 

U2=X2 + XS[o = [lip + A)5io + li^l - 9^822. (20) 

where S'Jq, S\q, S\\ and S22 are independent A/'(0, 1) random variables to encode w\q, w\q, W\\ and W2 respectively. 
IJ2 is the auxiliary random variable for binning that encodes W2- Xi and X2 are the transmit signals of Si and 5*2. 
The parameters a, f3, 7, /i are power allocation factors satisfying the power constraints 

+7^ < Pi, 

P^<P2, (21) 
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where Pi and P2 are transmit power constraints of 5*1 and 5*2. 

An important feature of the signahng design in pO] ) is p (— 1 < p < 1), the correlation factor between the 
transmit signal (X2) and the state (S'iq) at 5*2. In traditional dirty paper coding, the transmit signal and the state 
are independent. Here we introduce correlation between them, which includes dirty paper coding as a special case 
when p — 0. This correlation allows both signal forwarding and traditional binning at the same time. A is the partial 
decode-forward binning parameter which will be optimized later. 

Substitute Xi, X2 into Yi, Y2 and Y in ([19]), we get 

Yi = {a + bfip)S[Q + pSio + 76*11 + bfi\/Y^^~fP S22 + Zi, 



Y2 = {aa + P.p)S[q + apSio + ajSn + p.y/l - p^S22 + ^2, 

Y = caS[^ + c/35io + c^iSn + Z. (22) 

Corollary 1. The achievable rate region for the full-duplex Gaussian-CRC using the PDF-binning scheme is the 
convex hull of all rate pairs (Ri, R2) satisfying 

Ri<c( ff ^ \ 



C272 + 1; \b^p^{l- p^) + l 

{a + bfipf + + 7^ 
b^p^{l-p2) + l 



Ri<C 

where —1 < p < 1, C{x) ~ ^ log(l + x), and the power allocation factors a, /?, 7 and fi satisfy the power 
constraints \2\) . 

Proof: Applying Theorem 1 with the signahng in ( |20] i, we get the rate region in Corollary [T] ■ 

Remark 6. Maximum rates for each sender 

• Setting p = ±1, /i = p\/p2, we obtain the maximum rate for Ri as in partial decode-forward relaying: 

i?r"= , max min <j C f J^, ^ ) + ^(^^)^ C (^(a + &v^) ' + 7'^ | ■ (24) 



• Setting p = 0, /3 = 7 = and p, — \fP2, we obtain the maximum rate for R2 as in dirty paper coding: 

R^^^ = C{P2). (25) 

C. Optimal binning parameter for full-duplex PDF-binning 

In this section, we derive in closed form the optimal binning parameter A for ( |20l ) to achieve rate region ( |23] l. This 
optimal binning parameter is different from the optimal binning parameter in dirty paper coding, as we introduce 
the correlation factor p between the transmit signal and the state. This correlation contains the function of message 
forwarding. For example, if we set p — ±1, X2 will only encode w'iq without any actual binning, hence realize the 
function of message forwarding. If we set /? = 0, PDF-binning becomes dirty paper coding without any message 
forwarding. For < \p\ < 1, PDF-binning has both the functions of binning and message forwarding. Thus, 
PDF-binning generalizes dirty paper coding. 
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a=0.8, b=0.6, c=1.2, P1=1.4, P2=2 
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Fig. 5. Effect of the binning coiTelation factor p. 



Theorem 3. The optimal A for the full-duplex PDF-binning scheme is 

Proof: The optimal A* is obtained by maximizing both rates Ri and i?2. In rate region through the Fourier 
Motzkin Elimination process, we can see that if we maximize the term I{U2',Y2) — I{U2]Tiq), both Ri and R2 
are maximized simultaneously. We have 

/(C/2;i"2)-/(f/2;Tio) 

= H(Y2) - H{Y2\U2) - H{U2) + H{U2\Tio) 
= H{Y2) + H{U2\T,o) - H{U2,Y2). 
Here A only affects the last term H{U2,Y2). The covariance matrix between U2 and Y2 is 

var(C/2) E{U2,Y2) 



COv([/2,r2) = 



(27) 



E{U2,Y2) var(r2; 
where 

var([/2) ^ p^ + X'^ + 2/ipA, 
E(C/2,r2) = ifip + X)iaa + fip) + - p""), 

var(r2) = (aa + fJ-pf + + + - P^) + 1- 
Minimizing the determinant of the covariance matrix in ( |27] i, we obtain the optimal A* in (|26]l. ■ 
Remark 7. Effect of p\ 

• If p = 0, A* becomes the optimal A for traditional dirty paper coding pTj , which achieves the maximum rate 
for i?2 as in ( p5| l. 

• If p = ±1, A* differs from the A in traditional dirty paper coding and achieves the maximum rate for R\ as 
in (|24ll. 
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• The effect of p can be seen in Figure |5] The dashed Hne represents the resulting rate region using only DPC- 
binning (p = 0), while the solid line represents the region for PDF-binning when we adapt p e [—1,1]. Figure 
[5] illustrates that the correlation factor p can enlarge the rate region. 

D. Signaling and rates for full-duplex Han-Kobayashi PDF-binning 



In the Gaussian channel, input signals for the HK-PDF-binning scheme in Section III-B can be represented as 

Tio = a^ioKio)' 

Uio = aS[^{w[^) + /3S'io(wio), 

Uii = 7S'ii(wii), 

Xi = aS[^{w[^) + fiSi(i{ww) + 7S'ii(wii) + 5Si2{wi2), 

U21 = 6'S'2l(w2l), 

X2 - eS2l{w2l) + p [pS[o{w[o) + Vl - P^S22) , 

U22 =X2 + XS[o = {pp + X)S[o + dS2i{w2i) + pV^-P^S22, (28) 

where S'Jq, Siq, Sh, S12, S21, S22 are independent A/'(0, 1) random variables to encode w[q, Wiq, Wh, W12, 
W22, respectively. U22 is the auxiliary random variable for binning that encodes W22- Xi and X2 are the 
transmit signals of Si and 82- p is the correlation coefficient between the transmit signal and the binning state at 
5*2 (— 1 < /O < 1). A is the PDF-binning parameter The parameters a, f3, 7, S, 9 and p are power allocation factors 
satisfying the power constraints 

+ /S"^ + + S"^ < Pi, 

e^ + p^<P2, (29) 

where Pi and P2 are transmit power constraints of Si and 5*2. 

Substitute these variables into the Gaussian channel in ([19]), we get 

Y = caS'iQ + cpSio + cjSii + c6Si2 + Z, 

Yi = ia + bpp)S'io + I^Sia + 7^11 + ^^12 + beS2i + 6/1^1^^22 + ^1, 

Y2 = {aa + pp)S'iQ + a(3Sio + a7'S'ii + aSSi2 + OS21 + p\/l - /9^5'22 + ■^2- (30) 

Corollary 2. The achievable rate region for the full-duplex Gaussian-CRC using the Han-Kobayashi PDF-binning 
scheme is the convex hull of all rate pairs (Ri, R2) satisfying 

Ri < mm{l2+ I^Je} 

R2 < I12 — h 
i?i + i?2 < min{/2 + /y, h} + ^13 - h 
Ri+R2< min{/2 + I3, h} + In - h 
i?i + i?2 < min{/2 + /g, ho} + hi - h 
2Ri + i?2 < min{/2 + /s, 14} + min{/2 + IgJw} + ha - h 

Ri + 2R2 < mm{h + h, h} + hi -h+ hi - h (31) 
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where 

h = C 



h = c 



/7 = C 



/9 = C 

/io = C 
/ii - /i = c 



72 + ,52 + &202 



62^2(1 _ ^2) + 1 

(q + bA^p)2 +p^+j^+S^+ b2g2 
62;u2(l_p2) + l 

A*2(l-p2) 



a2/32 + ^2^2 _^ 1 



^12 - /l - C + C 

and a, (3, 7, 5, 6 and /i are power allocation factors satisfying the power constraints P9[) anc/ — 1 < P < 1- 
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Proof Applying Theorem [2] with the signaUng in ( |28] l, we obtain the rate region in Corollary [2] ■ 
Note that rate region ( (3T| ) includes both the Han-Kobayashi rate region and the PDF-binning region in ( |23] l. 
Furthermore, the maximum rates for user 1 and user 2 are the same as in (|24]i and ( |25] l. 

£. Optimal binning parameter for full-duplex Han-Kobayashi PDF-binning 
Corollary 3. The optimal A* for the full-duplex HK-PDF-binning scheme is 

Proof \* is obtained by maximizing the term In — Ii in (|9]l. See Appendix [A] for details. ■ 
Note that the optimal A* in ( (32] l contains both the optimal A* for PDF-binning in ( p6] l and the optimal A for 
DPC binning pT) as special cases. 



F. Numerical examples 

In this section, we provide numerical comparison among the proposed PDF-binning and HK-PDF-binning 
schemes, the original Han-Kobayashi scheme, and an outer bound as discussed below. 
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1) Outer bounds for the CRC capacity: We obtain a simple outer bound for the CRC capacity by combining 
the capacity for the (non-causal) CIC and the ourter bound for interference channel with user cooperation (IC-UC) 
||27). Where the CIC capacity result is not available, we use the MISO broadcast capacity. 

CRC capacity C CIC capacity IC-UC outer bound 

C MISO BC capacity Q IC-UC outer bound. 

a) Capacity of the CIC as an outer bound: The capacity of the ideal CIC (with non-causal knowledge of Si's 
message at ^2) is an outer bound to the CRC rate region. The CIC capacity is known in the cases of (i) weak 
interference |13|, fTT) (ii) very strong interference |12| (iii) the primary-decode-cognitive region p6) . For strong 
interference, we can also use the outer bound to the CIC capacity in p6) as an outer bound to the CRC. 

b) IC-UC outer bound: Tandon and Ulukus p7) obtain an outer bound for the MAC with generalized feedback 
based on dependence balance, which is first proposed by Hekstra and Willems |28J to study outer bounds for the 
single-output two-way channels. The basic idea of dependence balance is that no more information can be consumed 
than produced. Tandon and Ulukus apply this idea to obtain a new outer bound for IC-UC. It is shown that this 
dependence-balance-based outer bound is strictly tighter than the cutset bound (see Section V of |[27)). Thus, this 
bound can be used instead of the relay channel (RC) cutset bound for Ri. 

c) Gaussian Vector Broadcast Outer Bound: Consider a 2 x 1 MISO broadcast system as 

Yi^[l b]X + Zi, 

¥2^ [a 1]X + Z2, (33) 

where a, b are the channel gains, Zi and Z2 are white Gaussian noises with identity covariance. The vector codeword 
X consists of two independent parts: 



where X 



covariances: 



Xi \ 








K Vl ) 


V X2 j 








x = u + v, 



, and Ui, Vl, U2, V2 are zero-mean Gaussian codewords with 



r 



P2j5 



in which the power allocation factors satisfy 

a^ + P^ < Pi 



72 + 52 < P2 



(34) 



and the input correlation factors pi, p2 G [^li !]■ 

The Gaussian vector broadcast capacity region is the convex closure of Roi [j i?o2 p7) , where Roi is the region 

^ / a^+2bpial3 + b^P' 
^- \-f^ + 2bp2"fS + b^5^ + 1 

R2<C (a^-/^ + 2ap2lS + S^) 



(35) 



and Ro2 is the region 



Ri<C {a^ + 2bpiaP + b^ P^) 
0^72 + 2ap2i5 + (5^ 



R2<C 



a^a^ + 2apial3 + /32 + l 



(36) 
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a=0.8, b=0.6, c=1.2, PI =1.4, P2=2 
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Fig. 6. Rate regions for full-duplex schemes in the Gaussian cognitive relay channel. 



2) Numerical comparison: Figure |6] shows the comparison in the full-duplex mode among the Han-Kobayashi 
scheme, PDF-binning, HK-PDF-binning, and the outer bound. We can see that the proposed HD-PDF-binning 
scheme contains both the Han-Kobayashi and the PDF-binning rate regions, as analyzed in Remark [3] Note that 
the outer bound is the intersection of the two bounds drawn and is loose as this bound is not achievable. However, 
we observe that as b decreases, the HK-PDF-binning rate region becomes closer to the outer bound. 

V. Half-Duplex Coding schemes 

In this section, we adapt the two full-duplex schemes to the half-duplex mode. The half-duplex schemes are also 
based on rate splitting, superposition encoding, partial decode-forward binning and Han-Kobayashi coding. There 
are several differences between the half- and full-duplex cases. First, under the half-duplex constraint, no node can 
both transmit and receive at the same time, thus leading us to divide each transmission block into two phases. In 
the first phase. Si sends a message to 5*2, Ti and T2, while S2 only receives but sends no messages. In the second 
phase, both Si and S2 send messages concurrently. Second, Si sends different message parts in different phases. 
Specifically, Si only sends one part of its message to other nodes in the first phase, but will send all message parts 
in the second phase. Third, there is no block Markovity in the encoding since the superposition coding can be done 
between 2 phases of the same block instead of between 2 consecutive blocks. Finally, both Ti and T2 apply joint 
decoding only at the end of the second phase to make use of the received signals in both phases. 

A. Half-duplex partial decode-forward binning scheme 

The coding structure for the half-duplex PDF-binning scheme is shown in Figure |7] This scheme uses superposition 
encoding at the first sender, and partial decode-forward relaying and binning at the second sender The first sender 
splits its message into two parts (wio, Wn), corresponding to the forwarding and private parts. In the first phase. 
Si sends a codeword X™ containing the message part wiq, S2 sends no information but only listens. At the end 
of the first phase, S2 decodes wio from . Note that neither Ti nor T2 decodes during this phase. In the second 
phase, Si sends a codeword containing both parts {wio, wu), in which wu is superimposed on wiq. S2 now 
sends both W2 and wiq and uses Gelfand-Pinsker binning technique to bin against the codeword X{\(wio) decoded 
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® *® 

\ 

\ 

N 

X 

< ® © 

Fig. 7. Coding structure for tlie half-duplex CRC based on partial decode-forward binning. 

from Si in the first phase. At the destinations, Ti uses joint decoding to decode (wio, wu) from the signals received 
in both phases; T2 decodes W2 using the received signal in the second phase. 
Specifically, at the end of the first phase, ^2 searches for a unique wio such that 

where y is the received signal vector at ^2 in the first phase. It then performs binning by looking for a V2 such 
that 

and sends 2:22 (xii,U2) as a function of x^" and u™ in the second phase. 
At the end of the second phase, Ti searches for a unique (wio,wii) such that 

(4r(^io),42"(^^ii|^io),yi2) e 

and (4i"(*io),yii) G A(™)(PxiinJ, 

where yn and yi2 indicate the received vectors at Ti during the first and second phases, respectively. T2 treats 
the codeword Xl\ as the state and decodes W2- It searches for a unique W2 for some V2 such that 

where y22 is the received vector at T2 in the second phase. 

Theorem 4. The convex hull of the following rate region is achievable for the half-duplex cognitive relay channel 
using PDF-binning: 

{ Ri <Tl{Xii;Y) + fI{Xi2]Yi2\Xii) 
U] ^1 <T/(Xn;yii)+r/(Xu,Xi2;yi2) (37) 
[ i?2 <fI{U2;Y22)~fI{U2;Xii) 

where 

-P3 ^P{xii)p{xi2\xil)p{u2\xii)p{x22\xil,U2)Pc{yil,y21,y, 2/l2, 2/22 [a^ll , 3^12 , 2:22), 

and Pc is given in ([T]), f — 1 — t,0 < t < 1. 

Proof See Appendix |B] for the detailed proof. ■ 
Remark 8. The maximum rate for each user. 



Second phase ( t ) 
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Fig. 8. Coding structure for the lialf-duplex CRC based on Han-Kobayashi partial decode-forward binning. 



• The first user 5*1 achieves the maximum rate of half-duplex partial decode-forward relaying if we set U2 — 0. 

i?r"= max miii{r/(Xn;y)+f/(Xi2;ri2|Xii),r/(Xn;yn)+f/(Xn,Xi2;yi2)}. (38) 

0<T<1 

This half-duplex i?™^^ is slightly smaller than in the full-duplex case of ([3]l. 

• The second user ^2 achieves the maximum rate of Gelfand-Pinsker's binning if we set t — 0, X12 = Xu. 

max {I{U2;Y22)-I{U2;Xn)}. (39) 

p{xii,U2)p(X22\3:il,U2) 

This half-duplex R!^'^^ is the same as in the full-duplex case of Q. Even though this equality seems somewhat 
surprising, it is indeed the case in the limit of r ^ 0, given that user 1 sends just enough information for ^2 
to be able to decode completely in the first phase and then bin against it in the second phase. At r = and 
X12 = Xii =0, 52 can achieve the interference-free rate. 



B. Half-duplex Han-Kobayashi PDF-binning scheme 

The first half-duplex coding scheme utilizes PDF-binning at the second sender and achieves the maximum possible 
rates for both user 1 and user 2. But it does not include the Han-Kobayashi scheme for the interference channel. In 
this section, we extend this scheme to combine with the Han-Kobayashi scheme by further splitting the messages 
in the second phase. 

The coding structure for half-duplex HK-PDF-binning is shown in Figure |8] The encoding and decoding procedure 
in the first phase is the same as that of half-duplex PDF-binning. The major difference is in the second phase. 
Message wi of the first sender Si is split into three parts (wio, wn, W12), corresponding to the forwarding, public 
and private parts. Message W2 is split into 2 parts (11121,^22)^ corresponding to the public and private parts. We 
generate independent codewords for messages wio and wn and superimpose W12 on both of them. In the first 
phase, sends a codeword containing wiq, while S2 does not send any message. At the end of the first phase, ^2 
decode wio using the received signal vector y and then bins its private part W22 against the decoded message wiq, 
conditionally on knowing the public part W2i- In the second phase. Si sends a codeword containing (wio, Wu, W12) 
while S2 sends the binned signal containing (wiq, u'21, ^22)- At the end of the second phase, Ti uses joint decoding 
across both phases and searches for a unique triple (wio, wu, W12) for some W2i- T2 also uses joint decoding based 
on the received signal in the second phase and searches for a unique pair (11)21,^22) for some wn. 
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(40) 



Specifically, in the first phase, 5*1 sends x["(wio); 52 does not transmit. In the second phase, 5*1 sends a;]^2 ('^12|w'ioj Wu); 
S2 searches for some V22 such that 

(xrrKo),4l"Kl),42"K2, 1^22^21)) e Ai^-HPx,,U..\uJ, 

and then sends xl'^{wio,W2i,W22,V22)- 

For decoding, at the end of the first phase, 6*2 searches for a unique wiq such that 



(41) 



At the end of the second phase, Ti searches for a unique (wio, wii, W12) for some ■W21 such that 

{4liwio),ulUwil),xl^{wi2\wio,Wii),ul^ e Ai"^""^ iPx,,U^^X^2U2lY^2) 

and a;ir(t^io),yii)e4™n^x,,nJ. 
T2 searches for a unique {1^21, W22) for some {liu, V22) such that 

{ul{\wii),ul'^iw2l),ul^{w22,V22\w2l),y22) G A(^"H^'c/iiC/2iC/22y22 )• 



(42) 



(43) 



Note that similar to the full-duplex scheme in Section Ill-B we use conditional binning in step ( [401 ), ^"d joint 
decoding at both destinations in steps (|42]) and ( |43| l (see Remark |4|. 

Theorem 5. The convex hull of the following rate region is achievable for the half-duplex cognitive relay channel 
using the HK-PDF-binning scheme: 

Ri < min{/2 + /5,/6} 

R2 < I12 — h 

R1+R2 < min{/2 + It, h} + - h 

R1+R2 < min{/2 + /3, 14} + hi - h (44) 

R1+R2 < min{/2 + /g, ho} + hi - h 

2Ri +R2 < min{/2 + I3, h} + mm{h + h, ho} + hs - h 

Ri + 2R2 < min{/2 + h, h} + In - h+ In - Ii 



u 



where 



Pi ^p{xii)p{uii)p{xi2\uii,Xii)p{u2l)p{u22\u21,Xii) 

P{X22\X11 , U21, U22)P c{y 11, y 21, y, yi2, 2/22 , 2:12, a;22), 



(45) 



with Pc as given in ([TJ and 



h=fI{U22;Xii\U2l) 
l2^Tl{Xii-Y) 

h^fI{Ui2;Yi2\Xii,Uii,U2i) 

h = ThXii;Yii) + fI{Xii,Xi2;Yi2\Uii, U21) 

h = fI{Uii,Xi2;Yi2\Xii,U2i) 

h = r/(Xn; Fn) + f/(Xn, C/11, X12; Yi2\U2i) 

h^fI{Xi2,U2i;Yi2\Xii,Uii) 

h = tI{Xii-Yii) + f/(Xn, X12, C/21; Yi2|t/ii) 
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First phase ( r ) Second phase ( r ) 




Fig. 9. The half-duplex Gaussian cognitive relay channel model. 



/g -f/(C/n,Xi2,C/2i;Fi2|Xn) 
/lo = T/(Xn; Fn) + f/(Xu, f/u, X12, C/21; Y12) 

hl=fI{U22;Y22\U21,Uii) 
/12 =f/(C/21,C/22;r22|C/ll) 
/l3 =T/(C/ii,C/22;r22|{/2l) 

/l4 = T/(f/n,f/21,f/22;>22) (46) 

where f = l — t, 0<r<l. 

Proof: See Appendix [C] for the details. ■ 

Remark 9. Inclusion of half-duplex PDF-binning and Han-Kobayashi schemes. 

• The half-duplex HK-PDF-binning scheme becomes half-duplex PDF-binning if Uu = U21 = 0- 

• The half-duplex HK-PDF-binning scheme becomes the Han-Kobayashi scheme if t = 0, Xn = and ^22 = 

U22- 

• The maximum rates for Si and S2 are the same as in ((38| and ((39]l. 



VI. Half-duplex Gaussian CRC rate regions 

A. Half-duplex Gaussian CRC model 

The Gaussian model for the half -duplex cognitive relay channel is shown in Figure |9] The input-output signals 
can be represented as 



First phase : 


Y -- 


= cXn 






Yii -- 


= ^11 + 






Y21 -- 


= aXii 


+ Z21] 


Second phase : 


Y12 -- 


= ^12 + 


bX22 + Z12 




Y22 ' 


= 0-^^12 


+ ^22 + ^22 



(47) 



(48) 



where Xn is the transmit signal of Si in the first phase, X12 and X22 are the transmit signals of 5*1 and S2 in 
the second phase, respectively. Y, Yu and I21 are the received signals at S2, Ti and T2 in the first phase. Y21 and 
F22 are the received signals at Ti and T2 in the second phase, a, 6, and c are the channel gains where the direct 
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links are normalized to 1 as in the standard interference channel Q. Z, Zn, Z21, Z12, and Z22 are independent 
white Gaussian noises with unit variance. 

In the following section, we only provide the analysis for the half-duplex Gaussian HK-PDF-binning scheme and 
omit the analysis for half-duplex PDF-binning, which is a special case of HK-PDF-binning. 

B. Signaling and rates for the half-duplex HK-PDF-binning 



In a Gaussian channel, input signals for the HK-PDF-binning scheme as in Section |V-B| can be represented as 

^11 - «i5io(u;io), (49) 
X12 = a2'S'io(w;io) + hSiiiwii) -I- 725'i2(wi2), 

X22 = dS2l{w2l) + M (^pSio{wio) + \J\ - p'^S22^ , 

C^22 = -^^22 + A5io = (/^P + A)5'io + ^'S'21 + /iv^l - 9^822, 

where ^lo, S\\, iS'12, S2\ and 6*22 are independent A/'(0, 1) random variables that encode W\q, W12, W2\ and W22 
respectively, U22 is the Gelfand-Pinsker binning variable that encodes W22- The parameter p is the correlation factor 



between the transmit signal X22 and the state X\\, similar to that in Section IV-B A is a parameter for binning. 
Parameters a\, 02, /32, 72, Q and /i are the corresponding power allocations that satisfy the power constraints 

Ta?+f(a2+/?2+72) <Pi, 

T(p'+e')<P2, (50) 

where r and f ~\~ t are the time duration for the two phases. 

Substitute Xn, X12, X22 into F, Yn, Y21, Y12, ^22 in (|47} and (|48]l, we get 

Y — cai5io + Z, 
Yii — cki'S'io + Zii, 
Y21 = aaiSio + Z21, 

Y12 = (0:2 + bp,p)Sio + /32<5'ii + 72<S'i2 + b9S2i + 6/1^1 - P^S'22 + ^12, 



Y22 = {act2 + Pp)Sio + 0/325*11 + a72S'i2 + ^5*21 + AiVl - P^S22 + ■Z'22- (51) 

Corollary 4. The achievable rate region for the half-duplex cognitive relay channel using Han-Kobayashi PDF- 
binning is the convex hull of all rate pairs (Ri, R2) satisfying 





Ri 


< min{/2 - 


-/5,/6}, 






i?2 


</i2-/i, 






Ri 


+ i?2 


< min{/2 - 




- Ii3 — h 1 


Ri 


+ i?2 


< min{/2 - 




- Il4 — II , 


Ri 


+ i?2 


< min{/2 - 




+ I1I-I1, 


2Ri 


+ i?2 


< min{/2 - 




- min{/2 + /g, /lo} + /i3 - h 


Ri -f- 


2i?2 


< min{/2 - 




- Ill — Ii + In — h, 



(52) 
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where 

h = tC (c^a?) , 



h = tC [a{) + fC 
h = fC 



/ (a2 + biipf + 7I 



/7 = fC 



7| + 62(?2 



/g = tC [ai) + fC 
h = fC 



52^2(1 _p2) + l 



/ ^2+^2 + ^,2^2 



V&2/i2(l-p2) + l 



V 62^2(1 _ ^2) + 1 









f 1 








f 1 






0272 - 


f 1 
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+ 027! 4 
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(00:2 - 






-^2(1 


-p2)_ 


hi 



and C{x) = 0.5 log2(l + a;); t G [0, 1] and t + t — \; p £ [—1,1] is the correlation factor between 6*2 transmit 
signal X22 and the state Xn; and the power allocations ai, 0,2, P2, 72, Q ond p satisfy the power constraints 

m. 



Proof: Applying the signaling in ( |49] l to Theorem |5] we obtain the rate region in Corollary |4] 
Remark 10. Inclusion of half-duplex PDF-binning and Han-Kobayashi schemes. 

• If we set T = 0, ai = 0^2 = 0, p = 0, rate region ( |52j i becomes the Han-Kobayashi region |[8). 

• If we set /?2 = 6* = 0, rate region ( |52j i becomes the half-duplex PDF-binning region. 

• The half-duplex PDF-binning region is the convex hull of all rate pairs R2) satisfying 

Ri < tC'"-'"'^^ ' ' ^2 



Ri < tC (al) + fC 



A*2(i-p2) + i; ' 

/ (a2 + +7f 



yPp^il- p^) + l J ' 

^2 < fC (4^) > (53) 

0272 + 1 J 
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where the power allocations ai, a-i, 72 and /i satisfy the power constraints 



f/i' < Pi. (54) 



• The maximum rate for S\ is achieved by setting /32 = 6' = 0, p^ztl and /i = p^fPi as 

i?r"= max minJrC(c2a2)^-(^(^2)^^^(^2)^-(^// ^^^^\'^^2\ I (55^ 

rQ?+f(a^+72^)<Pi 1^ / J 

A solution for this optimization problem is available in |30J. Note that in the half-duplex mode, partial decode- 
forward achieves a strictly higher rate than pure decode-forward for the Gaussian channel. 

• The maximum rate for 5*2 is achieved by setting r = 0, p = 0, ai = q;2 = /?2 = 72 = ^ = 0, and /z = ^fPi as 

i?-- = C{Pi). (56) 
Remark 1 1. The optimal binning parameter can be found similarly to the full-duplex case as follows. 

Corollary 5. The optimal parameter A for the half-duplex Han-Kobayashi partial decode-forward binning scheme 
is 

Proof: Similar approach to the proof of Corollary |3] ■ 

C. Performance Comparison 

1 ) Existing results: Very few results currently exist for the CRC. We can only find two results for the half-duplex 
mode. Next we briefly discuss each of these results. 

Devroye, Mitran and Tarokh pO| propose four half-duplex protocols with rate region as the convex hull of the 
four regions. One protocol is the Han-Kobayashi scheme for the interference channel, and the other three are 2-phase 
protocols in which 52 obtains 6*1 's message causally in the first phase as in a broadcast channel, then transmits 
cognitively in the second phase. All these 3 protocols have Ti decode at the end of both phases instead of only at 
the end of the second phase, hence they are suboptimal. Protocol 2 has the idea of decode-forward by keeping the 
same input distribution at 5*1 in both phases, but because in the second phase, it reduces rate at Si, thus it does not 
achieve the rate of decode-forward relaying. Thus, even though the rate region includes the Han-Kobayashi region 
(in protocol 3), it does not include partial decode-forward relaying. 

Chatterjee, Tong and Oyman p4) propose an achievable rate region for the half-duplex CRC based on rate- 
splitting, block Markov encoding, Gelfand-Pinsker binning and backward decoding. The transmission is performed 
in B blocks, each is divided into two phases. In each phase, each user splits its message into two parts, one 
common and one private. The primary user (5*1) superimposes its messages in both phases of the current block on 
the messages in the first phase of the previous block. The cognitive user {S2) only transmits in the second phase 
and bins both its message parts against the private message of Si in the first phase of the previous block. Backward 
decoding is then used to decode the messages after B blocks. We have several comments on this scheme: 

• Block Markovity is not necessary in half-duplex mode. We can superimpose the second-phase signal on the 
first-phase signal of the same block, instead of superimposing both phase signals on the first-phase signal 
of the previous block and using backward decoding as in p4). Such a half-duplex block Markovity incurs 



29 



a=1 .6, b=1 .8, c=1 .2, P1 =1 .4, P2=2 



0.7 






0.6 






X 




\. 

V 


g.0.4 




\ \* 

\ u 


CVJ 

DC 0.3 




\ \ \ 

\ q) * 


0.2 


-^HD PDF-Bin 
-•-HK 




A \ \ 
\ q) \ 

\ 1 m 


0.1 


-e-HD HK-PDF-Bin 









-B-FD HK-PDF-Bin 


' M 


— ^ — m 



0.1 0.2 0.3 0.4 0.5 0.6 0.7 0.8 0.9 



R1 ( bps / Hz ) 

Fig. 10. Comparison of four coding schemes (HD = lialf-duplex, FD = full-duplex). 



unnecessarily long decoding delay and also wastes power to transmit the first-phase information of the current 
block, which is decoded backwardly. 

• Joint decoding of both the state and the binning auxiliary random variable at Ti is not valid (similar to |!25^, 
p6)). The rate region is thus larger than possible, but can be corrected in this step. 

• This scheme only covers half-duplex decode-forward relaying (when there is no binning) instead of partial 
decode-forward relaying and hence achieves a maximum rate for Ri smaller than ( |55] l. 

2) Numerical Examples: In this section, we provide numerical results to compare the two proposed schemes 



with the Han-Kobayashi and other known coding schemes pO) , |34| for the half-duplex CRC. 

Figure [TO] shows the comparison between half-duplex PDF-binning, HK-PDF-binning and the Han-Kobayashi 
scheme. It can be seen that although PDF-binning has a larger maximum rate for Ri than the Han-Kobayashi scheme, 
it is not always better. But the half-duplex HK-PDF-binning rate region encompasses both the Han-Kobayashi and 
the PDF-binning regions. 



In Figure [TT] we compare the HK-PDF-binning schemes with existing half-duplex schemes for the CRC in pO) , 
34]. We can see that HK-PDF-binning is strictly better than all existing schemes. Furthermore, the proposed scheme 



is more comprehensive than the protocols in |10J and simpler than the scheme in |34|. 

These figures also show that the gap in achievable rates by the HK-PDF-binning scheme in the half- and full- 
duplex modes is quite small. Thus, the rate loss caused by the half-duplex constraint appears to be insignificant. 



VII. Conclusion 

In this paper, we have proposed two new coding schemes for both the full- and half-duplex cognitive relay 
channels. These two schemes are based on partial decode-forward relaying, Gelfand-Pinsker binning and Han- 
Kobayashi coding. The half-duplex schemes are adapted from the full-duplex schemes by sending different message 
parts in different phases, removing the block Markov encoding and applying joint decoding across both phases. 

When applied to Gaussian channels, different from the traditional binning in dirty paper coding, in which the 
transmit signal is independent of the state, here we introduce a correlation between the transmit signal and the 
state, which enlarges the rate region by allowing both binning and forwarding. We also derive the optimal binning 
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a=0.55, b=0.55, c=3.1623, P1=6, P2=6 
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Fig. 11. Comparison of the HK-PDF-binning schemes with existing schemes. 



parameter for each coding scheme. Resuhs show that the proposed binning schemes achieve a higher rate than all 
existing schemes for user 1 by allowing user 2 to also forward a part of the message of user 1. Furthermore, the 
Han-Kobayashi PDF-binning scheme contains both the Han-Kobayashi scheme and partial decode-forward relaying 
and outperforms all existing schemes by achieving a larger rate region for both users. Numerical results also suggest 
that the difference in achievable rates between the half- and full-duplex modes for the CRC is small. 



Appendix A 

Proof of the optimal binning parameter A* for full-duplex HK-PDF-binning 
To simultaneously maximize Ri and i?2 in region (|9]), we can simply maximize the term In — /i as follows. 

I{U22;Y2\U21,Un) - I{U22;Tw\U2l) 

- H{Y2\U2i, Un) ~ HiY2\U2i, U22, U^) ~ H{U22\U2i) + H{U22\Tw, U21) 

- H{Y^) - H{Yi\U'^^) - H{U'^^) + H({/22|Tio, U21) 
= H(Y^) + ff([/22|rio, U21) - H{U^^,Yi), 

where 

Y2 = Y2\U2i, Uii = {aa + tip)S[Q + a(3Sw + a5Sr2 + ^a/I - ^^^22 + Z2 
U'22 - U22\U2i,Uii - {^ip + X)S[^ + /iv/l-p2522. 
Note that A only affects the last term -ff ([^221^2)- The covariance matrix between U22 and Y2 is 

var((7^2) HU22.yi) 



cov(C/^2,r2') 



E{U'22,Yi) var(r2') 



(58) 



31 



where 

var(C/22) = + + '^^J'P\ 

vai-(y2') = [aa + Afp)^ + a^/?^ + a^fj^ + /i2(l - p^) + l. 
Minimizing the determinant of the matrix in ( |58| ) leads to the optimal A as in ( (32] i. 

Appendix B 

Proof of Theorem|4](Half-duplex PDF-binning) 
We use random codes and fix a joint probability distribution 

p{xii)p{xi2\xii)p{u2\xii)p{x22\xil,U2). 

A. Codebook generation 

• Independently generate 2'^^^^° sequences x^i ~ nfc=i ^(^^iife)- Index these codewords as a;"i(wio), wio G 
[l,2"'^i°]. 

• For each x^j^{wiq), independently generate 2"^" sequences Xi2 ^ 11^=1 ^(2^12^12^11^:). Index these codewords 
as xUwii\wio), mi e [1,2"«"], WW £ [l,2"^i'']. 

• Independently generate 2"(^2+^?2) sequences ^ Ilfc^i -P('"2fc)- Index these codewords as ^2 (""^2, "^2), ^2 & 
[1,2"^^] and V2 G [l,2"-"2]. 

• For each xii(u'io) and U2(w2,W2), generate one ^22 ~ Y[k=iPi^22i\xiik,U2k)- Index these codewords as 

a;^2Ko,w^2,f2), W2 e [l,2"«'^], V2 e [i,2"«i]. 

B. Encoding 

• In the first phase, 6*1 sends the codewords a;["(u'io)- *S'2 does not send anything. 

• In the second phase, Si sends a;[2 (i^'iilwio)- 
For S2, it searches for a V2 such that 

{xl^{wio),uriw2,V2)) e Af")(Px,,C/J. 

Such ti2 exists with high probabihty if 

R'2>fI{U2;Xn). (59) 

5*2 then transmits a;22 (w^iO: ^2, 'f2)- 

C. Decoding 

• At the end of the first phase, ^2 searches for a unique wio such that 

(4r(^io),y)e4™H^x,,y). 

We can show that the decoding error probability goes to as n —> 00 if 

Rio<TliXii;Y). (60) 
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• At the end of the second phase, Ti searches for a unique (wio,Wii) such that 

and (4r(^«io),yii)e A(™)(Fx,,y,J. 

Here yn and yn indicate the received vectors at Ti during the first and second phases. The decoding error 
probabiHty goes to as n — >■ oo if 

Rii<fIiXi2;Yi2\Xn) 
Rio + Rii<fIiXn,X,2;Y,2)+Tl{Xn;Yn). (61) 

• T2 treats the codeword X™ from 5*1 as the state and decodes W2- It searches for a unique W2 for some V2 
such that 

(ur(^A2,«2),y22)eAf")(Pc,,y,J. 
The decoding error probabiUty goes to as n ^ cx) if 

R2 + R2<fI{U2;Y22). (62) 

Combine all the above rate constraints, we get 

R'2>fI{U2;Xii) 
i?io<r/(Xn;y) 
Rii<fI{Xi2;Yi2\Xn) 
Rio + Rii < f/(Xn, X12; ^12) + T/(Xn; Yii) 

R2+R!2<fI{U2\Y22). (63) 

Let Ri = Rio + Rii, apply Fourier-Motzkin Elimination, we get region ( |37| l. 

Appendix C 

Proof of Theorem [5] (Half-duplex HK-PDF-binning) 
We use random codes and fix a joint probability distribution 

p{xii)p{uii)p{xi2\xii,Uii)p{u2l)p{u22\u21,Xii)p{x22\xil,U21,U22)- 

A. Codebook generation 

• Independently generate 2"^i'' sequences x^^ ^ YTk^iPi^nk)- Index these codewords as ^"^(wio), Wio G 
[l,2"^i«]. 

• Independently generate 2"^" sequences w"^ ^ 11^=1 Index these codewords as Uii{wii), wn E 
[1,2"-^"]. 

• For each x"^{wiq) and u"^{wii), independently generate 2^^^^ sequences ~ Ilfc^i P(^i2fc|2^iifci '"iifc)- 
Index these codewords as a;"2(u'i2|wio, wii), W12 £ [l,2"^i^]. 

• Independently generate 2"'^^^^^ sequences Uji ^ 11^=1 P('^2ife)- Index these codewords as ^21(^21), W21 G 
[1,2"^^^]. 
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• For each U2i('"^2i)> independently generate 2"(^22+^22) sequences U22 ^ nfc=iP(^22fe|w2ife)- Index these 
codewords as m52(ic22, ^^22^21), W22 G [1,2"^=^], U22 e [1,2"^==]. 

• For each a;ii(wio), u^i{w2i) and ^22(^^22, 1^22 |w2i), generate one a;52 ^ I\k=i P{x22k\u22k, W2ife, ariu). Index 
these codewords as a;22(wio,W2i,W22,W22)- 

B. Encoding 

• In the first phase, sends the codewords Xf"(wio). ^'2 does not send anything. 

• In the second phase, sends aj^J ('"'i2|wi0jW^ii)- 
For ^2, it searches for some V22 such that 

{xlnWw),ul^{W2l),ulUw22,V22\W2l)) € 4^"H^X..C/..|C/. J- 

Such V22 exists with high probability if 

J?22 >T/(C/22;Xn|C/2l). (64) 

5*2 then transmits X22 (wio, ^21, W22, ^^22)- 

C. Decoding 

• At the end of the first phase, ^2 searches for a unique iuio such that 

We can show that the decoding error probabihty goes to as n 00 if 

Rio<rI{Xn;Y). (65) 

• At the end of the second phase, Ti searches for a unique iwio,wii,wi2) for some 'W21 such that 

{Xl^{ww),ul^{wii), XI^{W12\WW, Wii),ul^{W2l),yi2) e ") (PxiiC/iiXi2C/2iY-i2) 

and x™(u;io),yii) G 4™)(Px,,nJ. 
The decoding error probabihty goes to as n ^ 00 if 

i?i2 <r/(Xi2;ri2|Xn,[/ii,[/2i) 
Rio + R12 < Tl{Xn;Yn) + f J(Xn, X12; Yi2\Un, t/21) 

R1I+R12 < fI{Uu,Xr2]Yx2\Xu,U2l) 

Rio + Rn+Ri2<Tl{Xii;Yn)+fI{Xn,Un,Xi2;Yi2\U2i) 

Ri2+R2i<fI{Xi2,U2i;Yi2\Xn,Un) 
R10 + R12 + R21 < Tl{Xu;Yn) + fI{Xn,Xi2,U2i;Yi2\Un) 
i?!! + R12 + R21 < r/(C/n, X12, C/21; ri2|Xn) 
Rio + Rii + R12 + R21 < Tl{Xn;Yii) + fI{Xn, t/11, ^12, (^ai; ^12). (66) 

• T2 uses jointly decoding to decode (wii,W21,m'22). It searches for a unique (^21,^22) for some {wii,V22) 
such that 

{uli{Wii),ul^{u!2l),ul^{W22,V22\W2l),y22) G A'^J'''' {Pu,,U2iU22Y22) ■ 
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The decoding error probability goes to as n — > oo if 

R22 + R'22 < fIiU22;Y22\U2U C/ll) 

R21 + R22 + R22 < rI{U2i,U22;Y22\Un) 

Rll + R22 + R'22 < Tl{Uii,U22;Y22\U2l) 
Rll+R21+R22+R'22<rIiUn,U21,U22;Y22). (67) 

Let Ri = i?io + i?ii + Ri2 and R2 = R21 + R22, apply Fourier-Motzkin Elimination on the above constraints, we 
get region ( |44] i. 
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